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Challenges  in  Imaging,  Sensors,  and  Signal  Processing: 

>  The  3D  FPA 

>  On-Focal  Plane  Processing 

>  Room  Temperature  Imaging 

>  Next  Generation  Multi-color  & 

Adaptive  Hyperspectral  Sensors 

>  Sensor-on-a-Chip  -  Heterogeneous  Material  Integration 
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Noiseless  Imaging 
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Imaging  &  Sensing  Technology 
Urban  Scenario 


Snipers 


&  *  Ti 

Smoke 


Soldier 


MicroBots 


Sensing  technology  for  New  Platforms: 

•  Next  generation  Micro-vehicles 

❖  Air  and  Ground 

•  Integrated  sensing  in  multiple  bands 

•  Operation  in  day  /  night 

•  Wide  area  persistent  surveillance 

•  Information  available  on  the  ground 

•  Information  available  when  needed 

•  Decisions-aids  for  critical  information 


Warfighter  Will  Have  Inputs  from 


Multiple  Sources 
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Integration  of  these  inputs  into  a  common  picture  to  provide: 

❖  Threat  location 

❖  Situational  awareness  -  friend  and  foe 

♦>  Assets  available  from  other  units  /  platforms 

❖  Effect  of  operations 
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Imaging  Micro-System  Technology 


MM,|- 
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Current  Programs 


New  Thermal  Structures 


Photon  Detection 


Integrated  Multi-function  Detector 
with  Integral  Processing 

Spectrally  Adaptive  FPAs 


Two-Level  3-D  Stack  at  the 
Detector 


Technology  Enablers  Bridging  the 
Gap  to  New  Capability 

Integrated  Multiple 
spectral  bands 

Decision  making  at  the 
sensors 

High  density  3D 
Interconnections 

Noiseless  gain  at  the 
detector 


Autonomous  vehicles  with 
intelligent  sensing 

Sensors  for  micro/nano 
vehicles 

Panoramic  multi-spectral 
Imaging  in  all-environments 
De-graded  visibility  imagim 


HARD  A 


Three-Dimensional  Infrared  Focal 

Plane  Array 


matamim  rcms  rmsM/Tat-aav  arm or 


Combines  Digital  /  Analog 
Technologies  at  the  FPA 


VISA  Program  will  demonstrate  signal 

processing  at  each  pixel  Potential  for  Multi-level  “Smart”  FPA 


Two-level  Stack 

New  Capabilities  with  Multi-level 

•  High  Dynamic  Range  >  20  bits 

K 

FPA 

r 

•  High  Operating  Temperature 

S  Smart  Spectral  Processing 

•  Increased  Integration  Time 

* 

•  FPAs  adaptive  to  the  environment 

•  Higher  Performance  Two-Color 
Detectors 

•  On-chip  Decision  Making 

- j 

DRS/RTI _  Ra  ytheon/Ziptmnix 


The  Next  Generation  FPA 
Three-Dimensional  Architecture 


3D  Silicon  Read-out  Integrated  Circuits 


Silicon 


SiOr 


Silicon 


Results: 

•  2  Layer  Chain: 

•  1  Silicon  (7|jm) 

•  1  ROIC 

•  (106  vias;  8pc-c) 
99.998%  Operability 


Direct  Silicon  Bonding 


HgCdTe  HDVIP  Detector 


detector  contact 


VISA  via(4m  diameter 


Results: 

2  Layer  Stack: 

1  Silicon  (20pm) 


The  Next  Challenges 

•Higher  Density  Vias  -  <  1  um 

•Multiple  Wafer  Stacks 

•FPA  3D  Architecture 


25(am 


Passive  Si  layer 


1  ROIC 


(256x256;  30pc-c) 
99.98%  Operability 


High  interconnect  operability  Achieved  between  Silicon 
and  FPA  ROIC  /  Verified  with  Imaging  from  Analog  Chip 
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Thin  Epoxy  Bond 


Three  Dimensional  Multi-Project  Run 
Lincoln  Laboratory 
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Wide  Range  of  3D  Circuit  Designs  Completed  in  First  Multi-project  Run 


3D  FPGAs,  digital,  and  digital/mixed-signal/RF 
ASICs  exploiting  parallelism  of  3D-interconnects 
3D  analog  continuous-time  processor 
3D-integ rated  S-band  digital  beam  former 
Stacked  memory  (SRAM,  Flash,  and  CAM) 
Self-powered  CMOS  logic  (scavenging) 

Integrated  3D  Nano-radio  and  RF  tags 

Intelligent  3D-interconnect  evaluation  circuits 

DC  and  RF-coupled  interconnect  devices 

Low  Power  Multi-gigabit  3D  data  links 

Noise  cou p I ing/cross-ta Ik  test  structures  and  circuits 

Thermal  3D  test  structures  and  circuits 


22  mm 


3D  Ring  Oscillator  Cross-Sectional 


Three  Level  Silicon  Stack  using 
Silicon  On  Insulator  (SOI) 

Functional  3-tier,  3D-integrated  ring  oscillator 

-  Uses  all  three  active  transistor  layers,  10 
levels  of  metal  and  experimental  stacked 
3D-vias 

-  Demonstrates  viability  of  3D  integration 
process 
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Advanced  Imaging  Applications 
Large  Continuous  Data  Streams 
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Detai  on  Demand 


Issues: 


Imaging  Arrays  for 
Large  Area  Surveillance 


Sensor  Pre-Processing 

•  Change  Detection 


Feature  /  Edge  Extraction 


Adaptive  Spatial  Filters 

Preliminary  Decision  Making 

Thermal  Management/ 

Heat  Extraction 


Day  Night 

Persistent  Surveillance 
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Array  Format 


Room  Temperature  Infrared 


2000x2000— 

1280x1024— 

640x480  — 


50p  40p  30p 

Pixel  Size 


HDTV  IR: 


•  Multiple  Bands 

•  Electronic  Processing 
at  the  Sensor 

"1  i - m — 

20p  17p  12p  10p 


Sensor  on  a  Chip  Concept 
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Spectrally  Tunable 


Ultra  low  noise  - 
adaptive  to  high 
dynamic  range 


Intearated  Passives 

Adaptive  Sensor  Arrays 


Heterogeneous 
Materials 

Through-Wafer  Vias 
Silicon  Carrier 


High  Density 
Vertical  Interconnects 


Fine-Pitch 

Metal-Metal 

Bonding 


Adapted  from  Sensor  Integration 
Concept  RTI  /  DRS IR  Technologies  |  q 


Spectrally  Adaptive  Focal  Plane  Arra 
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Removable  cove 
(Indium  crush  seal) 


Vacuum  /  gas  fill 
pinch-off  tube 


MAIC 

Connector 


Windo 


MEMS  array  / 
MAIC  /  DB- 


Prototype  Integrated  Tunable  FPA  Planned  in  FY  07 


•  Future  tunable  FPAs  will: 

•  Adapt  to  the  environment 

•  Autonomously  detect  anomalies 

•  Select  spectral  band  to  optimize  contrast 

•  Analyze  scene  content 

•  New  Ideas  ? 


70% 


60% 


Wav e length  (ifn) 

Demonstrated  Fabry  Perot  Filters 
Tunable  from  8-10  um 


Chemical  Detection 
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Goodrich  -  Sensors  Unlimited  Raytheon 


Noiseless  Room  Temperature  FPA 
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State  of  the  Art  SWIR  Camera 
Input  Noise  40  -  50  e- 


High  Gain  Input  Circuit 


*1280  x  1024;  20  pm  pixels 

•  Short  Integration  1.8  msec. 

•  F/13  Optics 

•  Temperature -18  C 


State  of  the  Art  SWIR  Camera  High  Gain  Input  Circuit 
Input  Noise  40  -  50  e-  Input  Noise  ~  10  e- 


*  Integration  Time:  16  msec 

•  F/2.8  Optics 


•  Temperature +18°C 


Novel  High  Gain  q 
Input  Device  1 


Detecto 


Input  Amp 


T 

i 


c 


band-limit 


High  Gain  /  Low  (  zero  )  Excess  Noise 
Uniformity  in  Large  Arrays 
Unit  cell  ~  A 
High  Dynamic  Range 
Adaptable  to  high  Illumination 


Demonstration  of  Low  Read-out  Noise  SWIR 

Improvements  in  Imaging  with  Low  Noise 
Input  SWIR  20  pm  unit  cell 


Wafer  Bonding  Heterogeneous 

Materials 


Wafer  Die  Map  of  Average  3D-Via  Resistance  (Q) 
for  10,000-via  Chains  <  1  ohm 


3.4pm  6.5pm 

h  *\*  — H 


Tungsten  plug 
Tier  2  metal 
Bond  interface 
Tier  1  metal 


Lincoln  Laboratory: 


Photograph  of  150-mm  InP  Wafer  first  Steps  toward  Heterogeneous 

with  Aligned  and  Bonded  Tier  Integration  of  Imaging  Materials 


Wafer  Level  Integration  Photonic  Materials  with  Silicon: 

•  Narrow  band  detectors  integrated  with  state  of  the  art  CMOS  processing 

•  Extremely  large  arrays  -  potentially  wafer  level 

•  Higher  density,  smaller  size  pixels 
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Challenges  in  Imaging,  Sensors,  and  Signal  Processi 

Summary 


•  Three  dimensional  FPAs  and  signal  processors  provide  the  basis  for 
future  imaging  technology 

•  First  steps  taken  through  development  of  high  operability  interconnections, 
new  ideas  needed  for: 

❖  High  density  vias 

❖  Architecture 

❖  Heat  extraction 

•  Room  temperature  imaging  has  advanced  significantly,  but  future 
advances  needed  in: 

❖  Single  electron  noise 

❖  Broad-band  Imaging 

•  Demonstration  of  hyper  /  multi -spectral  imaging  at  the  sensor  provides 
first  steps  toward  FPAs  that  interaction  /  adapt  to  the  environment 

•  Sensor  system-on-a-chip  concepts  bring  together  information  from 
multiple  sensor  modes 
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